IMAGE COMPRESSION AND EXPANSION APPARATUS AND PIXEL NUMBER 

INCREASING APPARATUS 

BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

The present invention relates to an image compression 
and expansion apparatus for recording image data obtained by 
reducing the number of pixels of an original still image on to 
a recording medium and later reading the image data from the 
recording medium and restoring the original image. 

2 . Description of the Related Art 

In the past, as an example of image compression 
processing in an image compression and expansion apparatus, it 
has been known to find an average value of a predetermined 
number of pixel values included in the large number of pixels 
forming an original image, to generate a single pixel and to 
record a reduced image comprised of such pixels on to a 
recording medium. Further, in the image expansion processing 
in the image compression and expansion apparatus, the reduced 
image read from the recording medium is subject to 
interpolation so as to generate an enlarged image of the same 
number of pixels as the original image. 

On the other hand, another image compression and 
expansion apparatus is known to record DCT coefficients 
obtained by application of a two dimensional discrete cosine 
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transformation to a reduced image on to a recording medium and 
apply a two dimensional inverse discrete cosine transformation 
to the DCT coefficients read from the recording medium to 
obtain IDCT coefficients. The IDCT coefficients correspond to 
part of the pixels contained in the pixels of the original 
image. By applying interpolation to the IDCT coefficients, it 
is possible to generate an enlarged image of the same number 
of pixels as the original image. 

The enlarged image reproduced by an image compression 
and expansion apparatus should ideally match the original 
image, but since part of the information included in the 
original image is lost at the time of generating the reduced 
image, normally the original image is not matched and the 
quality of the image becomes relatively poor. 
SUMMARY OF THE INVENTION 

An object of the present invention is to provide an 
image compression and expansion apparatus for reproducing an 
expanded image corresponding to an original image from a 
reduced image, which can improve the quality of the expanded 
image . 

According to a first aspect of the present invention, 
there is provided an image compression and expansion apparatus 
comprising a reduced image generating processor, a reduced 
image recording processor, an orthogonal transforming 
processor and an expanded image generating processor. 
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The reduced image generating processor generates, based 
on original image data arranged in a first matrix comprised of 
a plurality of pixels, reduced image data arranged in a second 
matrix comprised of a smaller number of pixels than the first 
matrix. The reduced image recording processor records the 
reduced image data in a recording medium. The orthogonal 
transforming processor reads the reduced image data from the 
recording medium and applies orthogonal transformation to 
obtain orthogonal transformation coefficients arranged in the 
second matrix. The expanded image generating processor 

applies inverse orthogonal transformation to the orthogonal 
transformation coefficients to obtain expanded image data 
arranged in a third matrix comprised of a greater number of 
pixels than the second matrix. 

According to a second aspect of the present invention, 
there is provided an image compression and expansion apparatus 
comprising a reduced image generating processor, a reduced 
orthogonal transformation coefficient data recording processor 
and an expanded image generating processor. 

The reduced image generating processor generates , based 
on original image data arranged in a first matrix comprised of 
a plurality of pixels, reduced image data arranged in a second 
matrix comprised of a smaller number of pixels than the first 
matrix. The reduced image recording processor records reduced 
orthogonal transformation coefficient data obtained by 




orthogonal transformation of the reduced image data, in a 
recording medium. The expanded image generating processor 
reads the reduced orthogonal transformation coefficient data 
from the recording medium and applies inverse orthogonal 
transformation to obtain expanded image data arranged in a 
third matrix comprised of a greater number of pixels than the 
second matrix . 

According to a third aspect of the present invention, 
there is provided a pixel number increasing apparatus 
comprising an orthogonal transforming processor and an 
expanded image generating processor. 

The orthogonal transforming processor applies 
orthogonal transformation to image data arranged in a fourth 
matrix comprised of a plurality of pixels to obtain orthogonal 
transformation coefficients of image data arranged in the 
fourth matrix. The expanded image generating processor 

applies inverse orthogonal transformation to the orthogonal 
transformation coefficients to obtain expanded image data 
arranged in a fifth matrix comprised of a greater number of 
pixels than the fourth matrix. 

According to a fourth aspect of the present invention, 
there is provided a pixel number increasing apparatus 
comprising an expanded image generating processor that applies 
inverse orthogonal transformation to image data arranged in a 
sixth matrix comprised of a plurality of orthogonal 



transformation coefficients to obtain expanded image data 
arranged in a seventh matrix comprised of a greater number of 
pixels than the sixth matrix. 
BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention will be better understood from 
the description of the preferred embodiments of the invention 
set forth below, together with the accompanying drawings, in 
which : 

Fig. 1 is a block diagram of an image compression 
apparatus included . in the image compression and expansion 
apparatus according to a first embodiment of the present 
invention; 

Fig. 2 is a block diagram of an. image expansion 
apparatus included in the image compression and expansion 
apparatus according to the first embodiment of the present 
invention; 

Fig. 3 is a view of matrixes of image data processed 
in the image compression and expansion apparatus shown in Fig. 
1 and Fig. 2; 

Fig. 4 is a view of the reduction processing in a 
reduced image generator; 

Fig. 5 is a view of 8 x 8 pixel values of a second 
matrix and DCT coefficients corresponding to the image data 
comprised of the pixel values ; 

Fig. 6 is a view of the component relating to the DC 




component F(0) in the pixel value and the components relating 
to the AC components F(l), F(2), and F(3); 

Fig. 7 is a view of the DCT coefficients of an 8 x 8 
matrix and the pixel values comprising a third matrix of 
reproduced image data; 

Fig. 8 is a block diagram of an image compression 
apparatus included in the image compression and expansion 
apparatus according to a second embodiment of the present 
invention; and 

Fig. 9 is a block diagram of an image expansion 
apparatus included in the image compression and expansion 
apparatus according to the second embodiment of the present 
invention . 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

The present invention will be described below with 
reference to embodiments shown in the drawings. 

Figs . 1 and 2 are block diagrams of an image 
compression and expansion apparatus according to a first 
embodiment of the present invention. Fig. 1 shows an image 
compression apparatus, while Fig. 2 shows an image expansion 
apparatus . 

Light reflected from a subject being photographed SP 
is focused by a photographing optical system. 11, whereby an 
optical image of the subject SP is formed on the light 
receiving surface of an imaging device 12. At the light 
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receiving surface of the imaging device 12 are provided red 
(R) , green (G) , and blue (B) color filters. The imaging 
device 12 generates analog electrical signals corresponding to 
the R, G, and B images. These electrical signals are 
converted to digital electrical signals of the R, G, and B 
images at an AO converter 13. The R, G, and B image signals 
are converted to luminance data Y and color difference data 
Cb, Cr at a not shown image processing circuit and stored in 
a memory 14 . 

The luminance data Y and color difference data Cb, Cr 
are original image data comprised of approximately 1000 pixels 
in the horizontal direction and approximately 600 pixels in 
the vertical direction in the image arranged in a matrix. As 
described later, in a reduced image generator 15, image data 
is extracted from the original image data for every first 
matrix comprised of 64 x 64 pixels and the original image data 
of the first matrix is reduced. In the reduction processing, 
the original image data is converted to reduced image data 
comprised by a second matrix. The second matrix is comprised 
of a smaller number of pixels than the first matrix. That is, 
the reduced image data is compressed from the luminance data 
Y and the color difference data Cb, Cr stored in the first 
memory 14. The compression rate is for example 1/64. The 
reduced image data is recorded in a recording medium RM such 
as an IC memory card. 



The reduced image data corresponding to the luminance 
data Y and the color difference data Cb, Cr is read from the 
recording medium RM and subjected to a two dimensional 
discrete cosine transformation (DCT) at the DCT processor 21. 
That is, the reduced image data is converted to DCT 
coefficients. These DCT coefficients are subjected to the 
later described expanded two dimensional inverse discrete 
cosine transformation (expanded IDCT) at an expanded IDCT 
processor 22. Due to this, expanded image data comprised of 
a third matrix is obtained and stored in the second memory 23. 
The expanded image data corresponds to the original image data 
and is of the format of luminance data Y and color difference 
data Cb, Cr. Further, the third matrix is comprised of the 
greater number of pixels than the second matrix. The number of 
pixels is the same as that of the first matrix. 

Fig. 3 is a view of matrixes of image data processed 
in the image compression and expansion apparatus shown in Fig. 
1 and Fig. 2. Fig. 4 is a view of reduction processing in the 
reduced image generator 15. An explanation will be made next 
of the operation of the reduced image generator 15 referring 
to Fig. 3 and Fig. 4. 

The original image data is comprised of approximately 
1000 x 600 pixel values Pyx and is divided into unit blocks 
comprised of 8 x 8 pixels. In Fig. 3, the block Bl has the 
left corner block of the original image data as its origin and 



is positioned at the s-th block in the horizontal direction 
and the t-th block in the vertical direction. The first 
matrix Ml is comprised by 64 unit blocks comprising 8 blocks 
in the horizontal direction and 8 in the vertical direction. 
That is, the first matrix Ml is comprised of 64 x 64 pixel 
values Pyx. 

In the reduced image generator 15, a second matrix M2 
is generated for every original image data comprised of a 
first matrix Ml. The pixel value Rts in the second matrix M2 
is shown by the following formula (2) . That is, the pixel 
value Rts of the second matrix M2 is obtained by finding the 
average value of 8x8 pixel values Pyx comprising the block 
Bl in the first matrix Ml: 

sjcS+7 tx8+l 

Rts=( E E Pyx) //64 . . . (2) 

x~ ax8y- tx8 

The origin in the original pixel data is the pixel of 
the left corner CI of the image. x shows the coordinate of 
the pixel in the horizontal direction, while y is the 
coordinate of the pixel in the vertical direction. 

In the example shown in Fig. 4, the block Bl included 
in the first matrix Ml is comprised of the 64 pixel values Pyx 
of 160, 158, 183, 211, 221, 226... The average value 174 of 
the 64 pixel values Pyx is found as the corresponding pixel 



value Rts of the second matrix M2 . 

In this way, the second matrix M2 is comprised of 8 x 



second matrix M2 shows the original image by fewer pixels than 



positioned at the s-th block in the horizontal direction of 
the original image data and the t-th block in the vertical 
direction corresponds to the pixel PI positioned at the s-th 
pixel in the horizontal direction of the reduced image data 
and the t-th pixel in the vertical direction. 

Fig. 5 shows the 8x8 pixel values of the second 
matrix M2 and the DCT coefficients of these pixel values . In 
the reduced image data read from the recording medium RM, the 
pixel value Rts, which is a component of the second matrix M2 , 
is shown by an (s,t) coordinate system having the left corner 
C2 in the reduced image data as an origin. For the DCT, the 
pixel value Rts is converted to a coordinate system having the 
left corner C3 in the second matrix M2 as an origin in 
accordance with formula (3) : 



8 pixel values. 



The reduced image data comprised of the 



the original image data. 



In other words , the block Bl 
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The DCT is performed in accordance with the following 
formula (4) at the DCT processor 21: 



D^^CaCri E ^^co8 (2X+1)Un cos (2^D vn 
4 ,=07=0 yx 16 16 

where, Cu, Cv=l/^2 : u, v=0 
Cu , Cv= 1 : u , 0 



In the matrix MD comprised of the DCT coefficients 
D <S/t, vu obtained by the DCT, the DCT coefficient D (0 ' 0) at the 
origin (0,0) is the direct current (DC) component while the 
remaining 63 DCT coefficients D <s,t) vu are alternating current 
(AC) components. The DC component corresponds to the average 
value of the 8x8 pixel values comprising the second matrix, 
while the AC components correspond to the predetermined 
spatial frequency components. 

The expanded IDCT performed at the expanded IDCT 
processor 22 is described below. 

Here, for simplification of the description, the case 
where the matrix of the image data is arranged one- 
dimensionally , that is, one dimensional expanded IDCT, will be 
explained. 

The one dimensional discrete cosine transformation (one 
dimensional DCT) on the image data comprised of 8 pixels Px 
(==p o , P x , P 2 , . . . P) arranged one-dimensionally is expressed by 
the following formula (5) : 
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^, % 1 „ J, _ (2x+l) un /cv 

F(u) = — Cu E Pxcos . . (5) 

2 x , 0 16 

vhere , Cu- — ^- : u=0 
Cu-1 : u*0 

As can be understood from formula (5) , a spatial 
frequency component F(u) is obtained based on the pixel values 
Px at the 8 regions x by a one dimensional discrete cosine 
transformation. The number of types of spatial frequencies 
(i.e., the number of "u's") is equal to the number of regions 
x and is 8 in the case where the number of regions x is 8. 
That is, in this case, the DC component F(0) and the seven AC 
components F(l) , F(2) , ... F(7) are obtained. 

The one dimensional inverse discrete cosine 
transformation (one dimensional IDCT) is expressed by the 
following formula (6) : 

P'*=! i CuF(u)cos (^1) un (6) 



As can be understood from formula (6) , a pixel value 
P'x is obtained based on the 8 spatial frequency components 
F(u) by the one dimensional inverse discrete cosine 
transformation . 

Fig. 6 shows the component relating to the DC component 
F(0) and the components relating to the AC components F(l), 
F(2) , and F(3) in a pixel value P'x. The component AO of the 
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pixel value P'x relating to the DC component F(0) is expressed 
by: 

1 



-F(0) 



2^2 



The component Al of the pixel value P'x relating to the AC 
component F(l) is expressed by: 

1 , (2^+1) n 
— F(l) cos — 

2 16 

The component A2 of the pixel value P'x relating to the AC 
component F(2) is expressed by: 

1 2<2jr+l)n 
— F(2) cos — - - — 

2 16 



The component A3 of the pixel value P'x relating to the AC 
component F(3) is expressed by: 

3<2x:+l)n 

— F(3) cos 

2 16 

A pixel value P'x is the sum of the components of the 
pixel value P'x relating to all of the spatial frequency 
components F(0), F(l), F(2) , . . . F(7). For example, the pixel 
value at x=l is expressed by the following formula (7) : 
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P'=— i CuF(u)cos^l. . . (7) 
1 2 a=0 16 

where , Cu= -i- : u=0 

Cu-1 : u*0 

In Fig. 6, the components A01, All, A21, and A31 of the 
pixel values relating to the spatial frequency components 
F(0) , F(l) , F(2) , and F(3) in formula (7) are indicated. 

Using the same technique as when obtaining the pixel 
value P'i at x=l , that is, by interpolation at the curves of 
the components AO, Al , A2 , A3... (see Fig. 6) of the pixel 
value P'x relating to the spatial frequency components F (0) , 
F(l) , ... F(7) , it is possible to obtain the pixel values P'x 
at any region x. For example, the pixel values, when dividing 
the range 0 to 7 of the region x of the pixels equally by 64, 
that is, relating to x = 0, 0.125, 0.25, 0.375, 0.5, 0.625,... 
6.875, and 7.0, are obtained by formula (8): 

F'*=! I CuF(u) cos ^l)un (Q) 
2 U=0 128 

Note that in formula (8) , the denominator of the cosine 
was made 128 so as to handle the regions x as integer numbers. 

Further finely dividing the range of the regions x and 
performing inverse discrete cosine transformation in this way 
is called "expanded IDCT" in this specification. The expanded 
IDCT can also be applied to two dimensional array image data 
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in the same way as the case of such one dimensional array 

image data. Formula (9) shows a formula for performing the 

expanded IDCT in the case of a two dimensional array and 
obtaining the image values I' (s ' t) yx. 



7X 4 a=0n=0 " " tzb rzs 

J! 

According to the expanded IDCT shown in formula (9) , 
the 8x8 DCT coefficients D (s,t) vu comprising the matrix MD, as 
shown in Fig. 7, are transformed into a third matrix M3 
comprised of 64 x 64 pixel values I ,(S/t) yx. The third matrix M3 
forms the expanded image data as described above. 

The coordinates (x,y) of a pixel value I ,<s ' t) yx in the 
third matrix M3 are based on the pixel of the left corner as 
the origin in the same way as the second matrix M2 . 
Therefore, to return a pixel value I ,(3 ' t> yx of the third matrix 
M3 to the same coordinate system as the original image data, 
coordinate transformation is performed in accordance with 
formula (10) and the coordinate transformed enlarged image 
data is stored in the second memory 23 (see Fig. 1) . 



a a =J /(j, ' fc> . . . (10) 



As can be understood from formula (10) , the coordinates 
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of a pixel value I ,<S/t) yx in the expanded image data are 
obtained from the position (s,t) of the block Bl (see Fig. 3) 
corresponding to the third matrix M3 and the position (s-th 
block, t-th block) of the pixel value I ,<s,t, yx in the third 
matrix M3 . 

As explained above, according to the present 
embodiment, by applying DCT and expanded IDCT to the reduced 
image data, it is possible to obtain expanded image data 
(expanded image) of the same size and the same number of 
pixels as the original image data. In the expanded IDCT, as 
shown by formula (9) , the pixel values of the expanded image 
data are obtained by applying the two dimensional inverse 
discrete cosine transformation directly to the result obtained 
by the DCT to generate each of the elements forming the third 
matrix M3 . Therefore, according to the present embodiment, 
despite the loss of information at the time of generating 
reduced image data, it becomes possible to reproduce an image 
close to the original image and improve the quality of the 
reproduced expanded image. 

Note that the number of pixels forming the second and 
third matrixes M2 and M3 can be freely set. That is, when 
making nl, ml, n2 , m2 , N, and M positive integers, the second 
matrix is comprised of nl x ml pixels and the third matrix is 
comprised of n2 x m2 pixels. Here, n2 is 2 H times nl and m2 
is 2 M times ml. 
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In this embodiment, the number of pixels is reduced 
from the original image data to generate reduced image data, 
then the number of pixels is increased by the expanded IDCT to 
generate enlarged image data, but the reduced image data can 
be deemed original image data. That is, first, the two 
dimensional discrete cosine transformation is applied to the 
original image data comprised of the fourth matrix 
(corresponding to the second matrix M2) comprised of, for 
example, 8x8 pixels so as to obtain the DCT coefficients of 
the original image data. Further, the expanded IDCT is 
applied to the DCT coefficients to obtain expanded image data 
comprised of a fifth matrix (corresponding to the third matrix 
M3) comprised of, for example, 64 x 64 .pixels. By this 
configuration, it becomes possible to increase the number of 
pixels of original image data comprised by the fourth matrix 
to improve the quality of the reproduced image. 

Fig. 8 and Fig. 9 are block diagrams showing an image 
compression and expansion apparatus according to a second 
embodiment. Fig. 8 shows an image compression apparatus, 
while Fig. 9 shows an image expansion apparatus. The same 
reference numerals are used for components the same as or 
equivalent to the first embodiment shown in Fig. 1 and Fig. 
2. 

Components different from those of the first embodiment 
will be described. The reduced image data comprised of the 




second matrix M2 (see Fig. 3) comprised of 8x8 pixels 
generated in the reduced image generator 15 is subject to the 
two dimensional discrete cosine transformation at the DCT 
processor 16. The number of elements of the matrix MD (see 
Fig. 3) obtained by this, that is, the number of DCT 
coefficients, is 8 x 8. This is less than the first matrix Ml 
(see Fig. 3) forming the original image data. The matrix MD 
forms the reduced DCT coefficient data. The reduced DCT 
coefficient data is recorded on the recording medium RM. 

The reduced DCT coefficient data is read from the 
recording medium RM and the expanded two dimensional inverse 
discrete cosine transformation is applied at the expanded IDCT 
processor 22. Due to this, enlarged image data comprised of 
a third matrix M3 (see Fig. 3) is obtained. That is, in the 
second embodiment, since reduced DCT coefficient data 
comprised of DCT coefficients is recorded on the recording 
medium RM, no DCT processor is provided before the enlarged 
IDCT processor 22. 

The rest of the configuration and mode of operation are 
the same as those of the first embodiment. 

Note that in the second embodiment as well, it is 
possible to view the reduced DCT coefficient data as the 
original image data and apply expanded IDCT to it so as to 
increase the number of pixels. That is, first, expanded IDCT 
is applied to the DCT coefficients of original image comprised 
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of a sixth matrix (corresponding to matrix MD) comprised of, 
for example, 8x8 DCT coefficients to obtain enlarged image 
data comprised of a seventh matrix (corresponding to third 
matrix M3) comprised of, for example, 64 x 64 pixels. In this 
configuration as well, it is possible to increase the number 
of pixels of original image data comprised of the sixth matrix 
and improve the quality of the reproduced image. 

In the above embodiments, the two dimensional discrete 
cosine transformation was used for the orthogonal 
transformation and the two dimensional inverse discrete cosine 
transformation was used for the inverse orthogonal 
transformation, but the invention is not limited to this. It 
is also possible to use another known orthogonal 
transformation and inverse orthogonal transformation. 

As described above, according to the present invention, 
it becomes possible to provide an image compression and 
expansion apparatus for generating an enlarged image 
corresponding to an original image from a reduced image, which 
can improve the quality of the enlarged image. 

While the invention has been described with reference 
to specific embodiment chosen for purpose of illustration, it 
should be apparent that numerous modifications could be made 
thereto by those skilled in the art without departing from the 
basic concept and scope of the invention. 

Although the embodiments of the present invention have 
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been described herein with reference to the accompanying 
drawings, obviously many modifications and changes may be made 
by those skilled in this art without departing from the scope 
of the invention. 

The present disclosure relates to subject matter 
contained in Japanese Patent Application No. 11-14143 (filed 
on January 22, 1999) which is expressly incorporated herein, 
by reference, in its entirety. 



- 20 - 



